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ABSTRACT 



A system (10) presents a graphic guidance object (46) in a 
display screen (40) to aid a surgeon in guiding a probe (12) 
from an initial point (82) relative to a body (14) along a 
desired trajectory (54) to a target (52). The graphic object 
(46) may be presented simultaneously with a live video 
image (44) from an endoscope and with tomogram images 
(42). The graphic object (46) includes a probe tip indicator 
(88) and a trajectory indicator (94). These indicators (88, 94) 
are positioned relative to one another to graphically indicate 
how far and in which direction to move a probe tip (36) to 
cause the probe tip (36) to intersect the desired trajectory 
(54). A roll orientation feature (118) and a distance-to-target 
feature (126) are included in the graphic object (46). The 
graphic object (46) changes in real time to track movement 
of the probe (12). 

15 Claims, 5 Drawing Sheets 
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METHOD AND APPARATUS FOR GUIDING However, tomograms represent anatomy at a past point in 

AN INSTRUMENT TO A TARGET time and in a situation where the anatomy is not being 

TECHNICAL HELD OF THE INVENTION influenced by the surgery itself. Tomograms fail to reveal 

The present invention relates generally to the field of , ^ * * e instant ° f and ™*j tot 

surgery. More specifically, the present invention relates to 3 influ ? ncc of Cons ^ c ntiy, tomograms often fail to 

devices and techniques for guiding a surgical instrument to V^ovide accurate anatomical renditions existing during 

a target within a body part surgery, and relative position information indicated on tomo- 

« a ^ grams may not be accurate. Moreover, even if a tomogram- 

B ACKGROUND OF THE INVENTION based system happens to accurately portray relative instru- 

Less invasive surgery techniques are usually more desir- to ment position, nothing informs a surgeon about whether an 

able than more invasive techniques because the patient instrument's position is consistent with a specific trajectory 

suffers less trauma, suffers fewer side effects, and heals or about actions needed to cause an instrument to more 

quicker. For a given pathology, endoscopic surgery is often closely achieve a specific trajectory, 

less invasive than other surgical options. In endoscopic StU1 ^ system5 attcmpt to ^ 3 _ D 

surgery, a surgeon guides a relatively small endoscope n ^ ^ «uwupi w pcriurm extensive j u 

configured as a%>oe to a target region of a body putTte 15 COmpUter A enhancement and reconstruction of tomogram 

endoscope generates live video images of anatomyVncoun- T 8 " SUrgeiy in rCSp0nSC to mstrumcnt P* itioa 

tered at the tip of the probe, and the surgeon uses these video informa aon * ™ *> better allow a surgeon to 

images as an aid in guiding the probe to the target region. visualize instrument orientation and anatomy traversed by 

Similarly, a guided microscope can be employed to show me sur S ical instrument However, no amount of computer 

where a variety of instruments should be applied. Once the 20 reconstruction can make tomogram images taken at a past 

probe has been guided to the target a variety of surgical P° mt M time undcr non-surgical conditions to accurately 

techniques may then be performed at the target region. portray anatomy under the influence of surgery. Moreover, 

However, endoscopic surgery has conventionally been com P lex 3D computer analysis of tomogram images 

considered too dangerous where few distinctive visual fea- „ re ^ mres extensive computing power, causing a time lag 

tures are available within a subject body part. When few between me actual instrument positioning and the resulting 

distinctive visual features are available, the surgeon risks enhanced or reconstructed images. Such systems merely 

becoming disoriented while guiding the probe to the target rcact 10 acdons alrcady takcn ^ a s "rg e on and fail to 

region. This disorientation may cause the surgeon to inflict adequately inform a surgeon of what future actions are 

extensive trauma on the patient while failing to reach the ^ ncedcd t0 ^ m instrument along a specific trajectory to 

target region. Since few distinctive visual features are found a ****** Te & on - 

in the interior of many internal organs, such as the brain, sttmmaky of top TMVPtjnnM 

many pathologies have not been successfully operated upon SUMMARY OF THE INVENTION 

endoscopically. Accordingly, it is an advantage of the present invention 

Endoscopic surgery within the train has often been con- 35 that an improved method and apparatus for guiding an 

sidered exceptionally risky because a path followed by a instrument to a target are provided, 

probe in traversing from outside the body to a target region. Another advantage is that the present invention displays 

for example a tumor, should avoid critical or eloquent areas information to a user which indicates whether or not a 

of the brain to the maximum extent possible to prevent surgical instrument is positioned along a specific trajectory, 

permanent brain d^nage^ Consequently, not only does a 40 Another advantage is that the present invention displays 

probe or needle need to be guided to a target region, but the ,„f«™ a *;«« t« TT^ u ^ • a • ♦ • * 

Cok» *u~..ia ka ~„;a~a +~7u ► , _ - ^ 71 information to a user which indicates in which direction to 

probe should be guided to the target region over a specific move a ^ tip t0 ^usc a probe tip to intersect a specific 

route or trajectory. Disorientation and a resulting deviation trajectory ^ 

from a specific trajectory may lead to severe consequences A J . . ^ 

even wheo the target region is successfully reached, 45 * nt !? ,cr advant *g e ls mat f* cscnt invention automati- 

Various systems and techniques have been devised to let ^ ****** trajectory guidance information in real time, 

a surgeon know the location of a surgical instrument within Another advantage is that the present invention may 

a body even though few visual clues may be available. For combine trajectory guidance information with one or more 

example, various framed and framelcss stereotactic surgical of torao S ram and endoscopic images, 
techniques incorporate systems for informing a surgeon of so The above and other advantages of the present invention 

an instrument position. When such position information is carried out in one form by a method for presenting 

accurate, it may help a surgeon find a target region. guidance information to a user engaged in guiding a probe 

However, mere position information fails to inform a sur- to a target within a body. The method calls for identifying a 

geon about whether an instrument is on a specific trajectory, location for the target. A location for an initial point relative 
and such information fails to inform a surgeon of actions 55 t0 the body is identified. A current location for a tip of a 

needed to cause an instrument to more closely approach a probe is determined, A graphic object is then displayed. The 

specific trajectory. Consequently, a high risk of disorienta- graphic object indicates a direction in which to move the 

tion still remains when limited visual clues are present probe tip to cause the probe tip to intersect a predetermined 

In addition, various systems present tomogram images in trajectory which includes the target and the initial point 
combination with surgical instrument position information. 60 Orations. 

For example, during surgery a surgical instrument's position BRIEF DF *\CU tpttom hfthr nPAwrwr* 

may be superimposed or otherwise indicated on a tomogram BR1EF DESCRffTI0N 0F TW DRAWINGS 

which is viewable by the surgeon. These tomogram-based A more complete understanding of the present invention 

systems attempt to better inform a surgeon of whether an may be derived by referring to the detailed description and 
instrument is positioned as desired because a surgeon can 65 claims when considered in connection with the Figures, 

view instrument position relative to an overall tomogram wherein like reference numbers refer to similar items 

image, throughout the Figures, and: 
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HG 1 shows a block diagram of a guidance system; located for easy manipulation by a surgeon during : surgery 

SainsaschemaUcWewofaSsplaypresen^dto £ stenH*d at least to toe extent that .t ,s mampulated by 

a .far who is engaged in guiding a probe to a target within fc „ ^ LCD, plasma, or Cher 

abody * c , j 5 video terminal or projection device which visually presents 

FIG. 3 shows a flow chart of a setup procedure performed information to a sl ^ eoa or oth er user of system 10. Regard- 
by the guidance system; less of where other components of system 10 may be 
FIG. 4 shows a schematic view of a probe tip indicator located% a^y 24 is desirably located so that its visually 
feature of a graphic guidance object; presented information may be conveniently viewed by a 

FIG. 5 shows a schematic view of a trajectory indicator 10 during surgery, 

included in the graphic object ; Controller 16 additionally couples to a localizer 26 

FIG. 6 shows a flow chart of a track procedure performed through which controller 16 obtains location data. While the 

by the guidance system; preferred embodiment of system 10 uses a magnetic location 

FIG. 7 shows exemplary geometrical relationships determination system, the present invention may be prac- 
between a probe, an initial point, and a target; 15 ticed using acoustic, infrared, mechanical, or other location 

FIG 8 shows a schematic view of the graphic object in a deterniination systems known to those skilled in the art. 

situation where a probe tip is below and to the left of a Non-mechanical embodiments of such systems typically 

desired trajectory; and include a transducer 28 which provides an acoustic, optic, or 

FIG 9 shows a schematic view of a roll feature of the magnetic reference. Using transducer the locaUon of 
r Tl " 20 various sensors 30 may be determined. Transducer 28 and 

grapmc oDjecx. sensors 30 couple to localizer 26 via flexible cabling. 

DETAILED DESCRIPTION OF THE A scnsor 30' is located on a handle 32 of probe 12 and 

PREFERRED EMBODIMENTS generates location data regarding the position of sensor 30'. 

FIG. 1 shows a block diagram of a guidance system 10. Sensor 30 provides i^dS 
Guidance system 10 provides information which aids the 23 that track any movement m sensor 30 . Probe ^includes a 

STce of a probe 12 to a target located inside a body 14. shaft 34 at the end of which * 

P^Tl2 represents any mstrument which may be inserted given probe 12, Up 36 has a fixed ^ * 

Lito body 14 While any type of instrument constitutes probe sensor 30'. Controller 16 tocks the location^ M M M 

U ^purposes of the pTesent invention, an endoscope upon location data provided by sensor 30 and this fixed 

represents one particularly desirable form of probe 12. FIG. spatial relationship. 

1 illustrates body 14 in the form of a human head because Controller 16 also couples to an endoscope controller 3». 

system 10 is particularly suited to endoscopic surgery within Controller 38 is a conventional device for controlling endo- 

the brain. However, system 10 is not limited to brain or scope parameters. While not required, probe 12 is desirably 

endoscopic surgeries. System 10 may be used to advantage fitted with an endoscope which couples to controller 38 so 

in any surgery where a tool is desired which aids guiding that forward-looking, live video images taken from up 36 of 

probe 12 along a selected trajectory to a target. probe 12 are available to system 10. Guidance system 

Svstem 10 includes a guidance system controller 16. controller 16 couples to endoscope controller 38 o conttol 

CwnZovl medical, pisonal, or industrial computer endoscope parameters and to receive the resulting hve video 

components, such as a processor board, may serve as ^ images. 

controller 16. Controller 16 couples to a memory 18, a data System 10 may include other components which are not 
link port 20, a user input device 22. and a display unit 24. relevant to the present invention. Such other components 
Memory 18, data link port 20, user input device 22, and may include a video recorder configured to record images 
display 24 all represent conventional computer components appearing on display 24 during a surgery. Moreover, addi- 
commonly used in connection with medical, personal, 45 tional displays may be driven by controller 16. 
industrial, and other computers. FIG. 2 shows a schematic view of an example display 
Memory 18 stores databases used by system 10 and screen 40 presented to a surgeon engaged in guiding probe 
computer programs which define the operation of system 10 12 to a target within body 14 (see FIG. 1). Screen 40 
along with other data items. Such databases may include includes a tomogram slice 42, including associated alpha- 
digitized tomograms. The tomograms may be formed in 50 numeric data 42'. a live video image 44, a graphic guidance 
accordance with conventional CT, MRL PET, or other object 46. a plurality of selection buttons 48, and alphanu- 
tomographic techniques. Portions of the computer programs meric position data 50. 

which are relevant to the present invention are discussed Screen 40 is a tool to be used by a surgeon during surgery 

below in connection with FIGS. 2-10. in any manner deemed appropriate by the surgeon. In a 

Data link port 20 allows controller 16 to import external 55 typical scenario, the surgeon's primary focus rests on 

data For example, port 20 may represent a LAN port. graphic guidance object 46. Graphic object 46 changes in 

modem, removable disk drive, or tape drive. Among other real time to track movement of probe 12 within body 14. 

data items, tomogram databases, which may be supplied by Graphic object 46 includes several features which aid the 

external radiology or other computers, are received through surgeon in guiding tip 36 (see FIG. 1) of probe 12 to a torget 

port 20 60 52 along a desired trajectory 54. Generally, the relative 

User input device 22 allows a surgeon or other user of orientation and positioning of these Matures indJeate 

system 10 to enter selections and otherwise provide data to whether probe tip 36 currently resides on trajectory 54 It 

10 Such selections control the operation of system probe tip 36 does not reside on trajectory 54, then the 

M Tf": dSg an^ after surgery. C^ventional touch relative orientation and positioning ^^ featoes ^ 

sLTnrremote control devices/keyboards, pointing 65 a direction in which to move probe tip 36 to cause probe Up 

aevicL and^e a\l represent suitable examples of user 36 to intersect trajectory 54. TTiese features are discussed in 

input device 22. However, user input device 22 is desirably detail below. 
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In the typical scenario, die surgeon's secondary focus A task 60 identifies characteristics of a probe 12 to be used 

rests on live video image 44. When image 44 is generated by during an upcoming surgery. Task 60 may be performed 

an endoscope, it informs a surgeon of structures actually and when a user selects a particular make and model of surgical 

immediately in front of probe tip 36 In an alternate ernbodi- instrument from a menu selection of such instruments. Task 

f^^^T rr^^ 44 ^ enerated b * 5 60 defines a specific spatial relationship between probe tip 

a microscope (not shown). When a surgeon notices an artery ^ sensor 30' (see FIG 1) which arolies to the selected 

or other critical structure, probe 12 may be maneuvered to ^c^l^T™. 1 t ^ W ? £ . ^ 

avoid the structure. Fox surgeries withii the interior of the ^ " ™J ™*f**»te for variations 

brain and other organs, f™ visually distmctiv^c^ ? ^ } [^^^^^^ 

may be seen in live video image 44 until probe 12 nears ^ 12 and scnSQr 30 to accommodate a variety of 

target 52. Consequently, image 44 typically receives a 10 **** °^P rc ^ es & 

reduced level of attention by the surgeon relative to object A tas^ 62 aligns localizer data with tomogram imaging so 

46. that patient features match corresponding tomogram fea- 

In the typical scenario, the surgeon's tertiary focus rests turcs - Referring back to FIGS. 1 and 2, task 62 may be 

on tomogram slice 42. Tomogram slice 42 provides a performed by touching probe tip 36 to an alignment feature 

reference which may help the surgeon maintain a correct 15 64 fixed to the patient. Desirably, alignment feature 64 is 

sense of orientation. Those skilled in the art will appreciate configured to serve as a fiducial marker during tomographic 

that various critical structures, such as arteries, may not be imaging. Thus, one or more tomogram slices 42 depict an 

readily visible in the particular tomogram slice 42 showing object 64* corresponding to feature 64. Alignment feature 64 

on screen 40 at any given instant Moreover, even if such desirably resides in a fixed position on the patient during 

structures are visible, they may not actually be located at the 20 pre-surgery imaging and during surgery. Feature 64 may be 

precise position during surgery where they were located feed by being attached to bone or by being attached to a 

during pre-surgery tomographic imaging. Consequently, ^ worn by ^ patient during both imaging and surgery, 

tomogram slice 42 typically receives a reduced level of . . • ♦ ♦ * « , T »ur K a:y. 

attention by the surgeon relative to object 46 and live video At "? * ¥MI ustMlt T s y stem 10 **ows the location of 

image 44. * ^ probe tip 36 through the operation of localizer 26. By 

FIG. 2 illustrates target 52 and trajectory 54 in connection touchin 8 P™ 1 * tip 36 to alignment feature 64 (see FIG. 1) 

with tomogram slice 42. However, those skilled in the art whUe simultaneously identifying a pixel where object 64* 

will appreciate that tomogram slice 42 is a 2-D image, that ( m HG - 2 > is de P icte< ^ system 10 may learn the position of 

a typical target 52, such a tumor or the like, may very well alignment feature 64. Thereafter system 10 may translate 

be visible on only a few tomogram slice images out of an ^ between a coordinate system used by tomographic imaging 

entire set of tomogram slice images, and that trajectory 54 anc * a coordinate system imposed by localizer 26 through the 

may very well traverse a 3-D space relative to displayed use of wel1 known trigonometric relationships. Referring 

tomogram slice 42. Accordingly, FIG. 2 illustrates only a back ; to RG - ** * e conclusion of task 62 system 10 can 

projection of trajectory 54 on one particular tomogram slice obtain coordinates relative to localizer 26 for various points 

42 from a set of tomogram slice images. 35 depicted on the aligned tomograms. 

Selection buttons 48 form a menu structure which may be Procedure 56 includes a query task 66 that determines 

logically traversed by the surgeon or other user of system 10 whether an endoscope is activated. As discussed above, 

through manipulation of user input device 22 (see FIG. 1). probe 12 need not be an endoscope or contain an endoscope. 

User data provided through buttons 48 prior to surgery However, if an endoscope is available, a task 68 causes live 
initialize system 10 for an upcoming surgery. During surgery 40 video image 44 (see FIG. 2) to be displayed. Live video 

these user-supplied data may alter program settings to image 44 will thereafter continue to be displayed. Likewise, 

accommodate events which may be encountered during the procedure 56 includes a query task 70 that determines 

surgery. Alphanumeric position data 50 inform the user of whether tomographic images 42 (see FIG. 2) have been 

the precise position of probe tip 36 in relation to an X,Y,Z activated for display on screen 40 (see FIG. 2). If activated, 

coordinate system used by system 10 and of the distance 45 a task 72 causes a selected tomogram slice to be displayed, 

between probe tip 36 and target 52 at any given instant. Tasks 66 and 68 indicate that live video image 44 need not 

FIG. 3 shows a flow chart of a setup procedure 56 be displayed in all situations, and tasks 70 and 72 indicate 

" performed by guidance system 10. Procedure 56 is per- that tomograph images 42 need not be displayed in all 

formed interactively between a user of system 10 and situations. Live video image 44 may be omitted, for 

controller 16 (see FIG. 1). Controller 16 performs its portion 50 example, when image 44 is unlikely to be useful due to 

of procedure 56 under the control of a computer program endoscope clogging or when some other probe is being 

stored in memory 18 (see FIG. 1). For convenience, FIG. 3 guided to target 52 (see FIG. 2). Tomograph images 42 may 

illustrates procedure 56 through a flow chart. However, be omitted, for example, to allow larger viewing areas for 

many tasks performed during procedure 56 are independent the remaining items on display screen 40. 

of other tasks and need not be sequenced as indicated by this 55 Procedure 56 includes a task 74 in which probe roll is 

flow chart adjusted to a desired angle when a roll sensitive probe 12 is 

Procedure 56 includes a task 58 which gets a tomogram used. Task 74 is primarily a manual step. Roll represents a 

image database. Task 58 involves obtaining external tomo- clockwise or counterclockwise rotation around the axis of 

gram data through data link port 20 (see FIG. 1) and having probe 12. An endoscope is one example of a roll-sensitive 

a user select the appropriate tomogram database. In the 60 probe 12. Live video image 44 is oriented on display screen 

preferred embodiment, a tomogram database is selected by 40 in response to roll angle. Desirably, the top, bottom, right 

indicating a patient name which is associated with a par- and left sides of image 44 correspond to the top, bottom, 

ticular tomogram database. In addition, nothing prevents right and left sia^s, respectively, of probe tip 36 when probe 

multiple tomogram images from being obtained in task 58. 12 is held in its normal, operational orientation. Accordingly. 

Thus, a selected patient may have any number of CT, MRI, 65 during task 74 probe 12 is held normally and roU angle is 

or PET image sets available for use during an upcoming adjusted to a desired orientation. Task 74 may be performed 

surgery. by observing a distinctive pattern, such as printed text via 
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both live video image 44 and the naked eye. The endoscope indicator 88. The hash marks are spaced apart to indicate a 

may ^roUttd totoat the distinctive pattern shown in image predetermined distance, preferably m the range of 0.25 to 

M eSJme same orientation obsirvedby me naked eye. 1.0 cm. Ncthing requires the hash marks to be spaced apart 

44 camuiw j>ojii^ ^ nredetennined distance in display screen 40. Once 

A task 76 identifies tois roll * s ^SeT^obe tip indicator 88 need not change, 

orientation for system 10. In general, task 76represens a ™^™T, Us k 86 may be performed through software 

counterpart of manual task 74 that k performed _by system ^dm^^ ^ ^ ^ faltered in 

10. At some time foUowing completion of task 74. tesk 76 ^^fcTfar m upooming surger y. 

causes system 10 to record the roll orientation of probe 12. preparation ror an upco g urg 7 inH i„„ or w 

' . _. . . . . ^ i iicewise. a task 92 formulates a trajectory indicator !»4, 

Setupproccdum56ind^ sc ^^^^j^ shown in FIGS. 2 and 5. Trajectory indicator 
fortar S et52isidentmed.Tar g et52maybe M is a logical construction and may be formulated through 

me user causes a tomogram slice 42 m which target 52 is « ^ programming. Once formulated, 

visible to be displayed at display 24. When a tomographic J* ^cmre o^np p™* ^ 

hnage of target 52 is displayed, a user may au.se . video ^^^Z^<i through software programming 

display pointer, cursor, or toe like to r^deover tihe tomo- (j ™ J configured or altered in preparation for an 

graphic image of target 52. Using well known computer ' 6 

graphics techniques, the position of the tomographic target upcoming surgery 

taa» relative to the tomogram coordinate system may be Referring to FIG. 5 in me preferred emb^m trajec- 

SeTtom Se location^ointer pixels. Due to align- tory indicator 94 includes a * » 

ment task 62 discussed abovefmis position may be trans- , n vertical yaw line 98. which 'together partition two- 

2, for defining a desired trajectory 54 for probe 12 to follow 1 8 ^ 

Sy^gTwtT^ ^MfJS^J^tt 
S Jo ^So^when a user touches probe tip 36 four quadrants are defined to ^oo«^ o^Abgj 
to initial point 82 while simultaneously instructing system „ color is defined for an upper-right quadrant, medium colors 
M to W *e ^rdmates of probe tip 36 for use as initial are defined for lower-right and upper-left quadrants, and a 
Stat sTmSSm is selected by the surgeon based dark color is defined to a to w«-kft quadrant. Cona^enUy. 
STn toe lureeonT experience, the particular pathology pitch and yaw lines 96 and 98 and trajectory point 54 may 
^sStinglT^ger^dp^ent-spe^c anatomy con- be easUy implied by the intersections be^eec >*>*£"f 
stations In an alternate embodiment of the present „ contrasting colors. Moreov« .line* 96 and 98 
^SoTteaiectorv 54 may be coincident with an axis of a 35 point 54' may be easily distinguished from probe bp indi- 
r^one K emSent Initial point 82 may be cator 88 when overlaid thereon. FIG. 2 illustrates a situation 
ZZT^X^^or^T^ of the micro- where probe tip indicator 88 has been overlaid on trajectory 
outswc me Doay somcwu« c indicator 94. and trajectory indicator 94 is aligned with 

SC0 P C- ..... . . „- . nrnhe tin indicator 88. Due to this alignment, the cross hairs 

After the locations of Urget 52 and unual point 82 have n pi Xnd yaw lines 96 and 

been identified, a task 84 determines jajector, ^54 so to J ^Z^oT^UnX 36' overiies trajectory point 54". As 
trajectory 54 includes toe coordinates of target ^portion of trajectory indicator 94 which 

point 82. In the V«^**»*^£^* " * hW otoerwisTbeen viewable outside probe tip 

straight line segment extending between targetM and imti* J^g"™ ^ ^ omitted from object 46. 

^V^Jr^JnTCW; 45 't^ono^ 

However^stra^line trajectories are not a requirement, and procedure 56. system 10 may proceed to a track procedure 
Usk M^datenativetydefine various configurations of 100. which is performed to assist toe surgeon m the act of 
^eVtotltcoordinates for target 52 andinitial point guiding probe tip 36 to target 52. However^stem 10 
82 Traiectorv 54 desirably represents a curve defined x proceeds to track procedure 100 only In response to user 
^XZLn^v^ in accordant with toe * input and such user input need not bej provided uj*I system 
rSatesystemim^^^ ^^Sl^^^Z^^ 
JffiSSZ 2 ^t%c^V°s^X ^ "ntil toe surgeon is satisfied that system 10 and toe 
IwnZ HGS 2 and 4. Raring to FIGS. 2 and 4. probe 55 surgeon are ready for surgery. 

tip Tdicator 88 desirably includes vertical and horizontal FIG. 6 shows a flow chart of .rack preoeduK ,100. The 
oLs hairs residine within a circle. A probe tip point 36' operation of procedure 100 is described below m connection 
m^eJTme ^SctiTof th^aoss hik PrXtip point wito FIG. 7. which shows geometric re^onslup^een 
36® reoresentsXiutis of probe 12 as it would be viewed probe 12. initial point 82. and target 52 for a hypothetical 
SolSg down £ ritSpSZn. The perimeter of probe » situation. Those skilled in the art will appreciate toat for 
tiPtrfcS 88 Tf crmed as a circle to resemble toe clarity FIG. 7 shows only a two-dimensional projection 
perimeter shape of live video image 44 (see FIG. 2) from an three-dimensional geometry. 

£Xcope Referring to FIGS. 6 and 7, procedure 100 includes a task 

Inaddition.probetipindicator88 includes a feature 90 for 102 which "'^^^ ' 

indicating dismnces to trajectory 54. In the preferred 65 of probe tip 36^ Task MW2 « perfumed iiu " 
embodiment, feature 90 represents a set of hash marks on location date provided from localizer 26 andL «^or 30 (see 
bZtoTvertical and horizontal cross hairs of probe tip FIG 1). In the preferred embodiment, current coordinates 
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for probe tip 36 are expressed in accordance with an X.YJZ live video image 44. However, in situations where probe 12 
coordinate system established through the operation of is not round or is not straight, roll orientation becomes more 
localizer 26. After task 102, a task 104 determines a current critical to the problem of guiding probe 12 to target 52. 
probe roll angle. Roll angle is also determined in response Consequently, for these situations roll feature 118 desirably 
to location data provided from localizer 26 and sensor 30'. 5 operates as a portion of graphic object 46. 

Next, a task 106 determines a distance 108 extending in Referring to FIGS. 6-8, after task 116 a query task 122 
a generally perpendicular direction from trajectory 54 to evaluates distance 112 determined above in task 110 to 
probe tip 36. Distance 108 may be determined in response determine whether probe tip 36 is near target 52. In the 
to the trajectory denned above in task 84 (see FIG. 3) and to preferred embodiment, task 122 determines whether dis- 
the current location for probe tip 36 determined above in 1° tance 112 is less than a predetermined value. This predeter- 
task 102. Distance 108 represents the distance which probe mined value corresponds to the maximum distance indicated 
tip 36 has deviated from the desired path to target 52 In by distance-indicating feature 90. 

addition, a task 110 determines a distance 112 between probe When task 122 determines that probe tip 36 is near target 

tip 36 and target 52. Distance 112 represents the additional 52. a task 124 formulates and overlays a distance-to-target 
distance yet to be traversed before probe tip 36 reaches 15 feature 12 6 on graphic object 46. FIG. 2 depicts feature 126 

taI ^ ct 52. as a circle centered on probe tip point 36*. The radius of this 

After tasks 106 and 110, a task 114 positions and overlays circle is dimensioned in accordance with the scale defined 

probe tip indicator 88 (see FIG. 4) on trajectory indicator 94 through distance-indicating feature 90 to indicate distance 

(see FIG. 5). Positioning is performed in response to the 112. 

current position for probe tip 36 determined above in task 20 As probe tip 36 initially approaches target 52, feature 126 

102 and in response to trajectory 54 defined above in task 84 may not be visible because probe tip 36 is not near target 52. 

(see FIG. 3). Any portion of trajectory indicator 94 which This situation is depicted by an absence of feature 126 in 

extends beyond the perimeter circle of probe tip indicator 88 FIG. 8. As probe tip 36 Dears target 52, feature 126 becomes 

may be omitted. visible, and as probe tip 36 approaches target 52, distance- 

At task 114, indicators 88 and 94 represent logical con- to-target feature 126 shrinks upon probe tip point 36*. 
structions which may be carried out in memory 18 (see FIG. After task 124 and when task 122 detennines that probe 

1) and not actual visual images viewable through display 24 tip 36 is not yet near target 52. a task 128 causes graphic 

(see FIG. 1). Actual visual images are displayed later in guidance object 46 to be displayed at display 24 (see FIG. 
accordance with a task 128, discussed below. Nevertheless, M 1). In other words, task 128 actually causes visual images 

FIG. 8 shows a schematic view of graphic object 46 in a similar to those depicted in FIGS. 2 and 8 to be produced, 

hypothetical situation where probe tip 36 is below and to the As discussed above, object 46 may include various indica- 

left of trajectory 54. The hypothetical situation depicted in tors and features which provide a surgeon with useful 

FIG. 8 is consistent with the hypothetical situation depicted guidance information. Object 46 visually illustrates a direc- 

in FIG. 7. Unlike FIG. 2, FIG. 8 illustrates a situation where tion to move probe tip 36 to cause probe tip 36 to intersect 

probe tip indicator 88 is not aligned with trajectory indicator trajectory 54. In addition, the distance to trajectory 54 is 

94. Probe tip point 36' of probe tip indicator 88 resides at a visually illustrated. likewise, the distance to target 52 is 

location below and to the left of trajectory point 54'. The visually iUustrated, but only when probe tip 36 nears target 

direction in which to move probe up 36 to cause probe tip 52. Moreover roll orientation is visually illustrated. In 

36 to intersect trajectory 54 will be indicated in the visual accordance with tasks 68 and 72 (see FIG. 3), object 46 may 

image to be displayed during an upcoming task through a be displayed simultaneously with live video image 44 and 

graphic illustration, tomogram image 42 (see FIG. 2). 

In addition, trajectory indicator94 is positioned relative to Task 128 may additionally present other information at 

probe tip indicator 88 so that trajectory point 54' resides screen 40 (see FIG. 2). For example, current alphanumeric 

distance 108 (see FIG. 7) away from probe tip point 36* as 45 data 58 (see FIG. 2) may update a '^position of probe tip" 

expressed in accordance with distance-indicating feature 90 data field and a "distance to target" data field in screen 40 

***** M c^^ y 'if fT* fr ° m After task 128, a query task 130 detennines whether to 

probe tip 36 to trajectory 54 will be graphically indicated. rcfresh tomogram image 42 (see FIG. 2). If tomogram shoes 

After task 114, a task 116 formulates and overlays a roll 42 are being displayed and system 10 determines that a new 
feature 118 on the graphic object formulated above in task 50 slice now needs to be displayed, then a task 132 displays the 
114 or in any other location which may be desirable. FIG. 9 next tomogram slice. In addition, task 132 may perform 
illustrates roll feature 118 apart from other portions of other image processing tasks related to the tomogram image 
graphic object 46. Roll feature 118 includes a pointer 120 Procedure 100 performs a query task 134 after task 132 
which characterizes roll away from the initial roll angle and when task 130 decides mat tomogram image 42 does not 
obtained in task 76 (see FIG. 3). FIG. 9 depicts an orienta- 55 need to be refreshed. Task 134 determines whether to exit 
tion for roll feature 118 which represents no roll from the track procedure 100. User input received through the opera- 
initial orientation. On the other hand, in FIG. 8 pointer 120 tion of selection buttons 48 (see FIG. 2) may cause task 134 
indicates a counterclockwise roll of ^proximately 30° from to exit track procedure 190. Such user input may be received 
the original orientation. at any time during the process of guiding probe 12 to target 

Referring to FIG. 2, roll feature 118 coordinates graphic 60 52 as needed to revise the location of initial point 82. to 

object 46 with live video image 44. The roll orientation re-align localizer 26. to alter the configuration of screen 40 

indicated by roll feature 118 informs a surgeon which such as by displaying different types of tomograms, to adjust 

direction is up in live video image 44. When probe 12 is a parameters for the endoscope, and the like. In general, a 

round, straight instrument roll feature 118 may not be surgeon may exit track process 100 at any time and repeat 

needed for any purpose other than helping a surgeon main- 63 one or more of the tasks discussed above in connection with 

tain proper orientation while viewing live video images 44. setup procedure 56 (see FIG. 3). In addition, such user input 

Thus, roll feature 118 may alternatively be placed around may be received when probe 12 has been guided to target 52, 
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When probe 12 has been guided to target 52, a surgeon may, 
for example, cause system 10 to exit procedure 100 and 
display a full screen view of live video image 44. 

When task 134 determines that no user input has been 
received requesting an exit from procedure 100, program 
control loops back to task 102 to repeat procedure 100. As 
a result of continuously repeating procedure 100, procedure 
100 causes system 10 to track movement of probe tip 36 in 
real time. Those skilled in the art will appreciate that the 
tasks discussed above in connection with procedure 100 
require only relatively simple 2-D graphic techniques. 
Consequently, such calculations may be performed quickly 
by conventional personal computers so that no perceivable 
lag results between probe movement and the resulting 
depiction of a graphic guidance object in screen 40 (see FIG. 
2). 

In summary, the present invention provides an improved 
method and apparatus for guiding an instrument to a target 
the present invention displays information to a user which 
indicates whether or not a surgical instrument is positioned 
along a specific trajectory. In addition, information that 
indicates in which direction to move a probe tip to cause a 
probe tip to intersect the specific trajectory is displayed. 
Trajectory guidance information is automatically presented 
in real time in response to probe movement. After setup, a 
surgeon may concentrate on the surgical instrument and the 
graphic guidance object and need not otherwise control the 
system. Live video endoscopic images and/or tomogram 
images may be simultaneously presented with the graphic 
guidance object 

The present invention has been described above with 
reference to preferred embodiments. However, those skilled 
in the art will recognize that changes and modifications may 
be made in these preferred embodiments without departing 
from the scope of the present invention. For example, those 
skilled in the art will appreciate mat computer programs may 
be arranged in a wide variety of ways that do not necessarily 
resemble the precise program flow depicted herein but 
which nevertheless perform substantially equivalent func- 
tions. Moreover, those skilled in the art will appreciate that 
displayed information need not be configured precisely as 
described herein but that substantially equivalent informa- 
tion may be expressed and displayed in any number of 
different ways. These and other changes and modifications 
which are obvious to those skilled in the art are intended to 
be included within the scope of the present invention. 

What is claimed is: 

1. A method for presenting guidance information to a user 
engaged in guiding a probe to a target within a body, said 
method comprising the steps of: 

identifying a location for said target; 

identifying a location for an initial point; 

determining a current location for a tip of said probe; 

displaying a trajectory indicator, said trajectory indicator 
depicting a plane substantially perpendicular to a 
desired trajectory so that said desired trajectory appears 
as a single point in said plane, wherein said desired 
trajectory includes said target and said initial point 
locations; and 

displaying a probe tip indicator overlying said trajectory 60 
indicator, wherein said probe tip indicator corresponds 
to said tip of said probe and said trajectory indicator 
and said probe tip indicator feature together indicate a 
direction in which to move said probe tip to cause said 
probe tip to intersect said desired trajectory. 

2. A method as claimed in claim 1 additionally comprising 
the step of: 
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positioning said trajectory indicator and said probe tip 
indicator relative to each other so that when said probe 
tip indicator is aligned with said trajectory indicator 
said probe tip besides on said desired trajectory. 

3. A method as claimed in claim 1 additionally coirtprising 
the step of displaying a feature which indicates distance 
from said probe tip to said target. 

4. A method as claimed in claim 1 additionally comprising 
the step of presenting at least one tomographic image while 
said displaying step displays said graphic object 

5. A method as claimed in claim 1 additionally comprising 
the step of repeating said determining step, said trajectory 
indicator displaying step, and said probe tip indicator dis- 
playing step to track movement of said probe tip in real time. 

6. A method as claimed in claim 1 additionally comprising 
the step of defining said predetermined trajectory to be a 
substantially straight line. 

7. A method as claimed in claim 1 wherein said trajectory 
indicator displaying step comprises the step of configuring 
said plane into four quadrants so that said single point 
appearance of said desired trajectory is common to said four 
quadrants. 

8. A method for presenting guidance information to a user 
engaged in guiding a probe to a target within a body, said 
method comprising the steps of: 

identifying coordinates of said target; 
identifying coordinates of an entry point into said body; 
determining current coordinates for a tip of said probe; 
controlling a display to form a graphic object therein that 
indicates a direction in which to move said probe tip to 
cause said probe tip to intersect a predetermined tra- 
jectory which includes said target and said entry point 
coordinates and to form a feature in said graphic object 
which indicates distance from said probe tip to said 
target; and 

repeating said determining and controlling steps to track 
movement of said probe tip. 

9. A method for presenting guidance information to a user 
engaged in guiding a probe to a target within a body, said 
probe being configured to generate live video images, and 
said method comprising the steps of: 

identifying coordinates of said target; 
identifying coordinates of an entry point into said body; 
determining current coordinates for a tip of said probe; 
controlling a display to indicate a direction in which to 
move said probe tip to cause said probe tip to intersect 
a predetermined trajectory which includes said target 
and said entry point coordinates; 
repeating said determining and controlling steps to track 

movement of said probe tip; and 
presenting said live video images in said display while 
said controlling step causes said display to indicate said 
direction in which to move said probe tip to cause said 
probe tip to intersect said predetermined trajectory. 

10. An apparatus for presenting guidance information to 
a user engaged in guiding a probe to a target within a body, 
said apparatus comprising: 

means for identifying a location for said target; 
a localizer configured at least in part to identify a location 

for an initial point relative to said body; 
a controller, coupled to said localizer and to said identi- 
fying means, said controller being configured to deter- 
mining a current location for a tip of said probe and to 
determine a direction in which to move said probe tip 
to cause said probe tip to intersect a desired trajectory 
which includes said target and said initial point loca- 
tions; and 
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a display, coupled to said controller, for displaying a 
trajectory indicator, said trajectory indicator depicting a 
plane substantially perpendicular to said desired trajec- 
tory so that said desired trajectory appears as a single 
point in said plane, and for displaying a probe tip 5 
indicator overlying said trajectory indicator, wherein 
said probe tip indicator corresponds to said probe tip 
and said trajectory indicator and said probe tip indicator 
feature together indicate a graphic object which illus- 
trates said direction in which to move said probe tip to to 
cause said probe tip to intersect said desired trajectory. 

11. An apparatus as claimed in claim 10 wherein said 
controller is further configured to form said graphic object to 
include a feature which indicates distance from said probe 
tip to said target 

12. An apparatus for presenting guidance information to 
a user engaged in guiding a probe configured to generate live 
video images to a target within a body, said apparatus 
comprising: 

means for identifying a location for said target; 

a localizer configured at least in part to identify a location 
for an initial point relative to said body; 

a controller means, coupled to said localizer, said probe, 
and said identifying means, for determining a current 
location for a op of said probe and for determining a 
direction in which to move said probe tip to cause said 
probe tip to intersect a predetermined trajectory which 
includes said target and said initial point locations, and 
said controller means further causing said display to 
present said live video images while simultaneously 
displaying a graphic object which illustrates said direc- 
tion in which to move said probe tip to cause said probe 
tip to intersect said predetermined trajectory; and 

a display, coupled to said controller, for displaying said 35 
graphic object 

13. A method for presenting guidance information to a 
user engaged in guiding a probe to a target within a body, 
said method comprising the steps of: 

identifying a location for said target; 40 
identifying a location for an initial point; 
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determining a current location for a tip of said probe; 

displaying a graphic object which indicates a direction in 
which to move said probe tip to cause said probe tip to 
intersect a predetermined trajectory which includes 
said target and said initial point locations; and 

forming a feature in said graphic object which indicates 
distance from said probe tip to said predetermined 
trajectory. 

14. A method for presenting guidance information to a 
user engaged in guiding a probe to a target within a body, 
said method comprising the steps of: 

identifying a location for said target; 
identifying a location for an initial point; 
identifying an initial roll orientation for said probe; 
determining a current location for a tip of said probe and 

a current roll orientation for said probe; 
displaying a graphic object which indicates a direction in 

which to move said probe tip to cause said probe tip to 

intersect a desired trajectory which includes said target 

and said initial point locations; and 
forming a display feature which is responsive to said 

current roll orientation of said probe relative to said 

initial roll orientation. 

15. A method for presenting guidance information to a 
user engaged in guiding a probe to a target within a body, 
said probe being configured to generate live video images, 
and said method comprising the steps of: 

identifying a location for said target; 

identifying a location for an initial point; 

determining a current location for a tip of said probe; 

displaying a graphic object which indicates a direction in 
which to move said probe tip to cause said probe tip to 
intersect a predetermined trajectory which includes 
said target and said initial point locations; and 

presenting said live video images while said displaying 
step displays said graphic object 
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